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FIG. 2a 



A new user registers his/her system with a 
central corpus repository by supplying 
information characterizing his/her speech, e.g.: „ 

- 1st language 

- Gender 

- Age 

- Number of years Target Language Spoken 

- When Target Language was learned 

- Speech samples ot calibrated utterances 



A best match is made between the user's speech 
samples and a library of available speech models. 



The user's system downloads these models. 
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The user's system monitors its performance, 
saving utterances that need correction, 

and the correction. correct utterance and label) 

- When the system is idle, e.g. late at night, 
these utterances and related information, 
(i.e. tags and corrections) are uploaded to 
the central repository. 

I 

Phonetically transcribe samples using a 40 
phonotactically-constrained network ^ 

L , 

Build fully shared network using 42 
transcriptions and canonical spellings 



FIG. 2b 



Using new data, find paths (transcriptions) 
through this model whose Viterbi scores are 
greater than scores for initial transcriptions. 
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Redistribute 
transcriptions 
as updates to 
user system 
lexicons 



When a sufficient number of 
under performing utterances 
for a given model set are 
detected, model set retraining 
is initiated 
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User systems using the same 
model sets are instructed to watch 
for, and upload utterances that 
were problematic for other users 
when they are encountered. 
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When sufficient number of high quality 
samples are uploaded, the model set is 
retrained or created as a new speaker class. 



This retrained model set is 
redistributed to users 



FIG. 3A 



Requests New User 

Primary Language 

Gender 

Age 

Height 

Weight 

Number of Years Target Language has 
Been Spoken 

Age when Target Language is Learned 
Sample of Calibrated Utterances 
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Compare User's Speech Sample with 
Library of Stored Speech Models 
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Find Best Match Between this Sample and 
a Set of Stored Speech Models 




New Sample 



FIG. 3A 
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Add Sample and Subword Label 
to New Training Campus 




Using Phono tactics 

and Other 
Conventional speech 
Recognition Rules 
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Send to Central Data Base the Corrected Speech 
Samples with their Corrections and the Acoustic 
Subword Strings Having the Best Viterbi Scores 

I 

Store in the data base the corrected 
speech samples, corrections and phoneme 
strings from registered users of the same class 





Are a sufficient 
"number of underperforming" 
utterances stored 
Jn the data base?. 



Either Create New of Retrain Existing Speech Models 
by Building New Models from the Stored Speech Samples 
Correction Data and Acoustic Subword Strings 
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Download New Models to Appropriate User Sites 
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C End ) 



I hereby claim foreign priority benefits under Title 35, United States Code, § 1 1 9 of any foreign 
application(s) for patent or inventor's certificate listed below and have also identified below any foreign 
application for patent or inventor' s certificate having a filing date before that of the application on which 
priority is claimed. 
Prior Foreign Application(s) 

Number Country Day/Month/Year Filed Priority Claimed 

N/A Yes No 



I hereby claim the benefit under Title 35, United States Code, §119 of any United States 
provisional application(s) listed below. 

U.S. Provisional Application Number Filing Date 

I hereby claim the benefit under Title 35, United States Code, §120 of any United States 
applications) listed below and, insofar as the subject matter of each of the claims of this application is 
not disclosed in the prior United States application in the manner provided by the first paragraph of Title 
35, United States Code §112, I acknowledge the duty to disclose information which is material to 
patentability as defined in Title 37, Code of Federal Regulations, § 1 .56 which became available between 
the Filing date of the prior application and the national or PCT international Filing date of this 
application. 

Application Status 

Serial No. Date of Filing patented, pending abandoned 

I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application and 
transact all business in the Patent and Trademark Office connected therewith: 



Peter C. Toto 
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No 


36,293 


Jaime A. Siegel 


Reg 


No 


39,027 


Harold T. Fujii 


Reg. 


No 


38,458 


Frederick J. Zustak 


Reg. 


No 


36,728 


Larry Liberchuk 


Reg 


No 


40,352 


Mark Gorman 


Reg 


No 


43,641 


Aditya Krishnan 


Reg 


No 


41,531 


Ronald C. Card 


Reg 


No 


44,587 


Milton M. Frazier 


Reg 


No 


44,687 



Send Correspondence and direct telephone calls to: 

Sony Electronics Inc. 
123 Tice Boulevard - MD Tl-1 
WoodcliffLake,NJ 07675 
Telephone: (201) 930-7951 
Fax: (201) 930-6854 
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